DOCUHEHT BESOHE 



ED 095 014 



SE 018 076 



AOTHOR 
TITLE 

PDB DATE 
MOTE 



EDRS PRICE 
DESCRIPTORS 

IDENTIFIERS 



ABSTRACT 



Loose, Kenneth D. 

Some Basic Statistical Procedures for ATI Studies in 
Science Education. 
Apr 74 . 

8p.; Paper presented at the annual meeting of the 
National Association for Research in Science Teaching 
(47th, Chicago, Illinois, April 1974) 

MF-$0.75 HC-$1.50 PLUS POSTAGE 

♦Educational Research; *Science Education; 

♦Statistical Analysis; Statistics 

Aptitude Treatment Interaction (Statistics) ; ATI; 

♦Research Reports 



The purpose of this paper is to indicate a procedure 
for the analysis of data in which aptitude-treatment interactions are 
suspected. Procedures used in preliminary examination of data are 
discussed, after which the focus is on when to use analysis of 
covariance and aptitude-treatment interaction analysis. Finally, the 
steps in determining aptitude-treatment interaction are specified. 
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The purpose of thi^s presentation is to indicate a rela- 
tively simple procedure for the analycis of data in which aptitude- 
treatment interactions are suspected. As such, it is aimed at 
the practitioner and not meant as a rigorous statistical treatiaent, 
Aptitude-treatnient interaction analysis, though appearing complex, 
can explained fairly easily and carried out without much 
difficulty, Soiae computer programs exist which have the flexibil- 
ity necessary to do the analyses directly. The New York Buffalo 
Hultivarlate Analysis program and SAS (Statistical Analysis System) 
are examples. However, BI'iD programs, which are perhaps the most 
common in use, do not yield all of the inf orira-tion directly, so 
some mtXnual calculations are still necessary. Sometimes these 
programs also require icnowledge of regression a-nalysis in order to 
determine what is necessary in program setup and what parts of the 
printout are relevant » The procediores in this discussion are d3.rected 
at providing information vrhich can be utilised in a simple fashion, 
using concepts which are easy to manipulate and understand. 

Some initial procedures are useful in preliminary examination 
of the data. These are the calculation of means, standard deviations, 
and correlation coefficients for each treatment group for all variables. 

Paper presented at the National Association for Research in Science 
Teaching, April, 197^, Chicago, 111. 
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"both predictor (aptitude) and criterion,- Examination of the means 
and standard deviations of each group for the criterion scores 
gives somo indication of vrhother or not significant iiiain effects 
are present, When raeans and standard deviations among treatment 
groups for each variable are examined along^ vfith the correlation 
cofficients of each predictor-criterion combination for each 
treatment group i other outcomes are indicatnd/ Similarity betvjeen 
noans and standard deviations for predictor and criterion among 
treatment grouos as viell as similar correlation coefficients for 
each of the treatment groups indicates tliat there are not likely 
any significant main effects or aptitude -treatment interactions, 

Ususally, no significant differences are not quite so 
obvious. Fiain effects are easily investigated using analysis, of 
variance, Feasibility of attempting analysis of covariance or 
aptitude-trea/tment interaction analysis can be determined by further 
inspection. Both of these analyses are regression techniques. 
The rela.tionship betv:een regression coefficient, correlation coeffi- 
cient, and the standard deviation of the predictor and criterion 
is such tbxit an examination of the emans, standard deviations, and 
correlation coefficients can indicate vihether differences exist 
and the type of analysis uhich should be attempted. The relationship 
between regression and correlation coefficients is: 

" - r^» (1) 



The regression coefficient is represented by 'b^, is the standard 
deviation of the criterion measure, s,., the standard deviation cf 

A 

the predictor, and r^^ the correlation between the predictor and 
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criterion, A point to be nade in examining this relationship is 
tViat if the correlation is not significantly different froin zero, 
it can 1>3 considered as £j^ro. In this ca.se, the re^^ressiou 
coefficient is also sero and the predictor does not predict the 
criterion a Aptitude -treatment interaction analysis or analysis 
of covariance is thvz mea^nlnslesG with coxTelatioiii-i v:hich are not 
sisnifica.nt. 

Because relationship (1) exists, sotp-O specific considerations 
of the data and the der^crlptive statistics indicate vrhat type of 
analysis tiay be px^of itable » rirst, if the .standard deviation of the 
predictor and the criterion are siid.].ar as well as having similar 
correlations for each treatment group but having means which differ 
substantially between treatraent groups > analysis of covariance is 
suggested using the predictor (or aptitude) as the covariate. 
Analysis of covariance assumes that the regression coefficient for 
•each treatment group be the" same, and this is indicated by the 
above conditions, 

* Second, if the standard deviation of the predictor and cri- 
terion variables differ substantially among treatment groups even 
though means and correlations betvreen predictor and criterion az^e 
similar, aptitude -treatmezit interaction ans-lysis is indicated 
because the regression coefficients for the different treatment 
groups will be different, In the third case, an examination of the 
correlations to see if the predictor-criterion pairs differ in 
magnitude among treatment groups also indicates the possibility, of 
aptitude -treatment interaction, No aptitude-treatment interaction 
exists if the regression coefficients are the same since this 
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eqiiality indicates that the aptitude predicts the same peri oriaance " 
for all groups and is dependent only on the jnagnitude of the 
at»titude score, 

Aptitude-treatr.ient interaction analysis is an attempt to 
determine vfhether or not the refpression coeeficients for the 
different troatnent groups differ significantly from one another. 
These coefficients represent the slope of the line vrhich would 
nresult from graphing the relationship between predictor (aptitude) 
and criterion. It indicates hovr mch the criterion increases Kith 
.,unit increase of the predictor. Statistically, aptitude -treatment 
interaction analysis can be described as testing for homogeneity 
ox re^cpression or the homogeneity of slopes for each treatment group. 
Consider diagram (2). If it is assumed that b^ and bg really do 
not differ significantly, and that differences are due tq error 
variance, then a regression coefficient v?hich is the same for the 
two trea^tments combined should be as good a predictor as either 
regression coefficient used for the appropriate treatment. If the 
coefficient for each treatment predicts better, that is, that the . 
pi^ediction results in less error than using the combindd predictor, 
then the regression coefficients for the treatments differ signifi- 
cantly and there is an aptitude -treatment interaction. 
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The procodiirG by uhich it is possible to determine whether 
regression coefficients differ sij;nif icantly requires various 
deviation scores. Therefore, the folloviins a.re necessary; 

i) the sum of the square of the dcvia^tion of predictor 
scores for ea.ch treatment 

U=1 1 ■ 

ii) the sui^i of the square of the deviation of criterion 

scores for each treatraent 

i)Yf = P ( Y. - Y.f - s; (n. - 1) {k) 
1 ^ ^ lu Y. ^ 1 ^ ^ 

iii) the sun of the product of deviation scores for the 
predictor and the deviation scores for the criterion for each 
treatraent group ^ 

^ £ (X. - X. )( Y, - YJi 

1 ^ ^ XU X"^^ lU 

(5) 

-r^^.(s.^)(sY^)(n. . if 

«i» X 

In these, i denotes the treatment group, n, the number in the 
treatment, X the predictor, Y> the criterion, and s, the standard 
deviation. 

The calculations of deviation scores are not difficult to 
do but can be sonewliat tedious. However^ vrith lanoirledge of the 
means for all treatment groups, deviation scores and siuns of squares 
and products can be done quiclcly if the sample is small. For larger 
samples 5 a coniputer has usually been used to get means and standard 
deviations for all variables in all treatraent groui)s. In this case, 
equations (3)> (^')t ^-^'^i (5) indicate hovr the deviation scores 
necessary can be obtained from the standard, deviations and correlation 
coefficients . 
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It is thon necessary to calculate regression coefficients 
for each treatment group. -These are obtained by 'taking the sum of 
the deviation product for trat c-roup arid dividing it by the sum 
of the square of the deviation scores of the predictor for the 
treatment g"i:oiii>. 

b . -^'i 

1 - — — (o) 

irhere b^ is the re.^iression coefficient for treatment group i. There 
\?ill be as it\any b^'s as there. are treatment groups. 

The coefficient used for considering groups combined, 
indicated as bi^,, is found by taking the sum of all of the deviation 
products for all trea*tments and dividing it by^he sum of all the 
squares of the deviation scores for the predictors in all 
treatments, 

m 

Three different sums of squares are necessary. The first 
is 33 (b^) which is found by taking the sum of the product of the 
regression coefficient squared and the sum of squared deviations 
of predictor scores for each treatment as shovm in equation (8). 

33 (b ) = 2 ^2 (8) 
SS(b) is obtained by taking the sum of all of the sums of squared 

t 

deviation scores for all treatments and multiplying it by the 
regression coefficient of the combined groups squared as shown 
in equation (9)» 

m 

SS(b) = tip E DX? (9) 



A totel sum of squares, S3^^^, is found by adding all of the sums 
of the squa.res of deviation of criterion scores for all groups. 



S3^ . = Z DY? 
Tot VI i 

The remain der of the analysis for homogeneity of regression 
is shown in the table belov<» 



Soiirce 


Suin 01 Soiia^res 


di 


J'lean Square 


Regression 


d3(K) - SS(b) 


n -.1 






Residiial 


3o^^.^ - SS(h^ - 2(S3(b)) 


if ~ 2m 

i 
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As in the previous instances, m represents the nuraber of treatment 
groups (or regression coefficients) and H the totoal number of ' 
subjects in all of the groups combined. The result obtained is an 
F-statistic vrith the degrees of freedom shown in the table. A 
significant F would then inaicate aptitude -treatinent interaction 
at that level of significance. Plotting the interaction is 
conventionally done by plotting the criterion on the Y-axis and the 
aptituaeor predictor on the X-axis. This requires that the Y 
intercept be calculated by taking the mean of the criterion score 
for that treatment and subtractirig it from the product of the mean 
of the aptitude score and the regression coefficient for that 
treatment . 

Int. = Y. - b.X. 

1 1 11 

It is relatively easy for someone with elemen-bary 
programming experience to incorporate the deviation equations 
given here into a program vrhlch takes raw data and calculates the 
F's. Alternatively, means ^ standard deviations, and correlations 
are also easily obrtained and can he used. BMD regression analysis 
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progTajns can a^^so be ursed bub 'duiiiiny codias' (coditig troatment 
group as a variab?Le) is necessary in oxxler to get the information 
needed » A covariance niatri>: ir^ printed in this case, arid the 
selection of appropriate pax'^tG of thivS matrix gives the sum of 
squared deviations and the siua of deviation^ products when multiplied 
by - GO only a few calcnl-ations are required. Since lar^^^e 
nuinbers of subjects in each treat laent group are defjir cable in order 
to reduce error in prediotioriy conpu'ber procedures vhich v:ork vrith 
ravr data a.re test, Usin^* means ^ standard deviations, and cox^relation 
coefficients does work but accuracy is dependent on carryins as 
many decimal places as possible, 

Hef eroncH 

Dra.per, N.R. and Smith, H. Applied RerTression Analysis. Ncvi York: 
John Viley and Sons, Inc., 1S^66, pp l-^^ld,, 



